Claims 



We claim: 



1 l\A method for determining probabilities of states of a system represented 

2 by a HK)del including a plurality of nodes connected by links, each node 

3 representing possible states of a corresponding part of the system, and each 

4 link representing statistical dependencies between possible states of related 

5 nodes, comprising: 

6 grouping the plurality of nodes into arbitrary-sized clusters such that 

7 every node is included in^t least one cluster and each link is completely 

8 contained in at least one cluster; 

9 defining messages based on the arbitrary- sized clusters, each message 

10 having associated sets of source nodes and destination nodes and a value and 

11 a rule depending on other messages ana^elected links connecting the source 

12 nodes and destination nodes; \ 

13 assigning initial values to the messages;\ 

14 updating the value of each message using the associated rule; and 

15 determining approximate probabilities of the states of the system from 

16 the messages when a termination condition is reached. \ 

1 2. The method of claim 1 further comprising: \ 

2 identifying nodes in intersections of clusters, and intersections of 

3 intersections of clusters as regions of nodes; \ 

4 defining the messages based on the regions of nodes. \ 
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1 3. The method of claim 1 wherein the network has pair- wise statistical 
2\ dependencies between nodes, and the overall probability of a particular 

3 \ssignment of states s at the nodes is: 

4 \ P(s l ,s 2 ,...s N ) = ±fl<t> ij (s, , Sj )JJ W ( Si ), 

5 where tne first product runs over all linked neighboring nodes, i and j 9 and 

6 wherein a ^compatibility matrix represents the statistical dependencies 

7 between the po^ible states s of the related nodes, and the ^function for 

8 each node represents evidence that a particular node is in a particular state, 

9 and Z is a normalization constant to insure that the sum of the probabilities 
10 of all possible states of the system is equal to one. 

1 4. The method of claim 1 whensmi the initial values of the messages are 

2 random positive numbers. \ 

1 5. The method of claim 1 wherein the initial values of the messages are all 

2 ones. \ 

1 6. The method of claim 1 wherein the termination condition is a convergence 

2 the probabilities of the states of the system to a predetermined precision. 

1 7. The method of claim 1 wherein the approximate probabilities are marginal 

2 probabilities. \ 



1 8. The method of claim 1 wherein the approximate probabilities 

2 maximum a posteriori probabilities. 
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9. The method of claim 1 wherein the states are discrete. 

1 \p. The method of claim 1 wherein the states are continuous. 

1 11. The method of claim 1 wherein the network model includes closed 

2 loops. 

1 12. The methocN^f claim 1 wherein the nodes are arranged in a square 

2 lattice. 

1 13. The method of claim\ wherein the nodes are arranged in a triangular 

2 lattice. 

1 14. The method of claim 1 whereih the nodes and links are a Markov 

2 network representation of an error-correcting code. 

1 15. A method for determining probabilities^ states of a system represented 

2 by a model including a plurality of nodes connected by links, each node 

3 representing possible states of a corresponding p^rt of the system, and each 

4 link representing statistical dependencies between possible states of 

5 neighboring nodes, comprising: 

6 grouping the plurality of nodes into arbitrary-sized\elusters such that 

7 every node is included in at least one cluster, and each link\s completed 

8 contained in at least one cluster; 

9 identifying nodes in intersecting clusters, and intersection^ of 

10 intersecting clusters as regions, and intersections of regions as sub^gions; 

1 1 discarding duplicate regions and sub-regions; 
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12 \ arranging the regions and sub-regions in a top-to-bottom hierarchy of 

13 intersections; 

14 defining messages between regions and direct sub-regions directly 

15 connected in theiiierarchy, each message having associated sets of source 

16 nodes and destinationhodes and a value and a rule depending on other 

17 messages and selected linksNx>nnecting the source nodes and destination 

18 nodes, the destination nodes beingthose nodes in the sub-region, and the 
-19 source nodes being those nodes in thetegion and outside the sub-region; 

20 assigning initial values to the messages: 

21 updating the value of each message using tfr^associated rule until a 

22 termination condition is reached; 

23 determining approximate probabilities of the states orttie system from 

24 the messages when a termination condition is reached. 
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